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FIELD 

10001] The present invention relates to transforms for image and video 
compression. 

BACKGROUND 

[0002) Transformation is an essential component of image and video coding A 
substantial number of compression standards utilize a Discrete Cosine Transform (DCT) 
which is an image-independent transform. DCT includes an algorithm, s.milar to Fast 
Fourier Transform, which converts data (pixels, waveforms, etc.) into sets of frequencies 
whereby, for compression purposes, latter frequencies are stripped away based on 
allowable resohttion loss. For vtdeo compression in devices with weak computational 
power mcluding some portable devices, the high complexity of DCT is not conducive to 
robust processing. Therefore, alternatives for DCT are being pursued, having low 
computational complexity and high compression efficiency. 

[0003] The pursuit of alternatives to DCT focuses on simplified transforms 
Examples of such approaches to such simplified transforms include (1) a factorization- 
based approach and (2) an integer transform kernel redesign approach. 

[0004] A factorization-based approach operates similarly to most fas, algorithms 
for DCT, which facorize DCT to the multiple of a Walsh matrix and some sparse 
matnees, and then approximate the floating-point coefficients of the latter by integer or 
bmary fractions. Examples of this approach include the C-matrix transform (CT) (Jones 
c« a.., The Karkunen-Loeve Discrete Cosine and Related Transforms Obtained via the 
Hada m ard Transform, Proc. Intl. Telemetering Conference, Los Angeles, Nov 1978 14 



PP. 87-98) and the rece„t. y popu.ar Integer DCT (IntDCT) with Ufting scheme (Chen et 
a.., Integer Discrete Cosine Transform (IntDCT), IEEE Trans. Signal Processing Feb 
2000, pp. ,. 5) . CT and IntDCT c.ose.y rese mb ,e DCT and are ahle to provdJ high 

partly a Wa.sh-Hada.nard transform and son, sparse matrices. Ahhongh spars^ 
matnces can be computed by fas, a.gorithtns, the tota, complexity is aiways a muItipl e of 
WHT, which is not easily reduced. 

[0005] The in«e g er transform kerne, redesign approach direcfly designs a s.mple 
matrix to replace the floating-point DCT. Th.s approach provides much freedom except 
for a matrix orthogonality restraint. The ehaiienge of this approach is that maintainmg 
mgh compression efficiency has proven to be a difficult task. 

[0006, A firs, method in the integer transform kerne, redesign approach starts 
w.«h scaling ,he original DCT by a large integer and then searching for int e g er 
coefficients with respect to orthogonality resections (G. Bjontegaard, Addition of Sx8 
Transform to H.26L, ITU-T Q,5/ SGI6> Document q,^ Red ^ ^ ^ ^ 
and Wien, e, a,., Integer Transforms for H.26L using Adaptive Block Transforms ITU-T 
Q15/SG.6, Document Q15-K-24, Portland, Oregon, Aug. 2000). A drawback of this 

increasing computational complexity. 

[0007] A second method in the integer transform kerne, redesign approach 
destgns a new symmetric and orthogona. matrix temp.ate and men produces a transform 
famfly. Representative results of the second method are Chant's integer cosme transform 
(ICT) (Cham, Development of integer cosine transforms by the principle of dyadic 
IEEE Proceedings, V„„3 6) PU , No ,, Aug . mg) ^ ^ 



OX L„, e, a, Devel „ ^ ^ ^ ^ ^ ^ 

tr * 00 S *"» *-> —s., Vol . 142, N „,, February 1995) ^ 
Worms can provide low comp]exi(y ta ^ unsatisfac ^ compressjon 

shifts, but it is completely incompatible with DPT TPT' 

wirn ULL ICT s representative (5 3 2 1) is 

SUMMARY 

10008, Ata^^^^^^ 

ail elements are power-of-2 elements. 
BRIEF DESCRIPTION OF THE DRAWINGS 

(0009, The scope of the present invention wi„ be apparent from the foUowi» g 
detaded Option, when taken m conpmCon with the aeeompan y i» g drawing and 
-* detaiied descnption, whiie ind.cating emhodiments of the invention, are given as 
ustratio ns on, y> sinee varrons changes and modifications wi„ hecome apparent to those 
sktHed m the art from the Mowing detaiicd description, in which: 

(0010, FIG. I i-flowchartinustratingprooessingflowknownmmearf 
.00„, FIG. 2 is a flowchart ihnstrating a processing according to an .amp.e 
embodiment. 

I00U, FIG. 3 is a flowchart iflustratmg a power-of-2 transform according to an 
example embodiment; 
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100131 FIG ' 4 Sh ° WS COmparatl ™ «*• of an exa mpI e embodiment against 
known implementations; 

10014] FIG. 5 shows further comparative results of an example embodiment 
against known implementations; and 

[0015] FIG. 6 illustrates a general computer environment which can be used to 
implement techniques described herein. 

DETAILED DESCRIPTION 

(0016, Example embodiments described herein include a transform matrix 
having elements composed of 2's low-order power. 

10017, Processing for spatial compression for image/video encoding is shown in 
FIG. ,. Motion compensation ,05 predicts vahies of pi xe,s by relocating a block of 
P.xe,s from a previous picture. Such motion is described by a 2-d.mensional vector or 
movement from its previous position. 

[0018, Bit rate reduction in spatial compression is to minimize duplication of 

«deo data from the space and time domain to the frequency domain using a DCT 
encoding method 1,0, and then applying quantlzation m ^ ^ ^ 
.echn,ques ,20 to reduce the bit rate. More particular,* after DCT encoding „ 0 the 
data is subjected to a quantization 1,5 process, weighted to reduce data in the high- 
frequency areas. More bits per pixe, are used to quantize the important .ow-frequency 
coefficients, and fewer bits per pixel are used to quantize the less-important htgh- 
frequency coefficient, Variab.e ,ength encoding ,20 assigns shorter code words for 
frequently occurring events and ,o„ger code words for less frequent events. 
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10029, Orthogonality, . basic property of a Wo™ W.. 
— of an S x S pi xe , .can b e w ritt e» as T- ^ S , V „..„ ^ ^ ^ 

an .he second is ^...^ ^ ^ ^ ^ ^ ^ > 
matrix to satisfy. 

(0020, According the e xa mp ,e etnhodiments described heren, indent 
-hng factors With the qua „,,ation process, so th e second constraint can he loosened 

f ^ " den ° ted ^ * ^ diag ^"' ^ is *— *y *en S*T* an 
wntten as , - W , Cons.dering .a, * is . dlagona , fte ^ rf 

or arbitrary maririxXcanbewri^nasX^C, where c^/V and . denotes dement- 
by-element muItlpli cario„ inste ad of no™. matri x mmriphcario, ^ h.fluence of no, 

^ 3,,.,) is used 10 replace the original (,, .... 31) quantizatio „ factor ^ £ 
— for an inverse transform can he sim.larly des lg ned. Tbe « cost of 

tables. By this e X amp,e emhodiment, si x addiriona, arrays are needed for the transform 
[0021 J According the second constrain, of orthogonahty can he fuifiUed in the 

Tha, ,s, hy the e xampI e emhodnnents, it is on.y necessary to make the 
matrix orthogonal to each other. 



i matrix. 
3 row vectors of a 



[0022] The following matrix T i 0 

ng matnx T, is a commonly used DCT template which 



1 1 1 1 1 1 
b c d -d - c -b - 
f ~f -e - e -f f 



-d - 

-1 -1 

-a d 

f -e e 

A -c b 



i i 
b -b 

-f -f 



-i -l 



«**T imw . Tha,i s ,^ reorthogonaltoeachotherand ^ i= ^ 
.0023, ^^n g(ab , ac + cd + b ^ 

« ♦ . + <*» , odd md W) is even , rendenng fte equation 

also cannot hold. 4"<*"on 
co—a, complexity and high compressjon effidency jo reduce 

z r „ a " e,emen,s e ~ as ~- 2 ' wi,h - 

corona, comp ,e xlty is consldered „ „ ^ * 
0mPre 7 effiden - ^ - * «* OCT, to high r J 

SO,Uh0nSTteis >^-.^.and/are„o t power-of-2. 
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» jeT COmPreSSi ° n effidenCy ' 3 -* ™— DCT, 

^theeo^^^^ Inontertofinda 

. efficiency, modiflcatjons (o fte temp]a(e ^ 

orthogonal.ty constraints described above. 

.0026, According to an example embodiment, matrix Ti, below, is obtained by 
^.changmgsomeordersandsignsinrows^r.,^^^^^ " 



1 



~C -h -. 



f -e 



1 1 1 1 

b c d -d 

f ~f -e - e -f f £ 

d -b b a - d - e 

~\ ~\ 1 1 -1 -1 1 

* ~b 



e -f _y 
b -a a 



-e f 
c -d, 



.0027, Fnrmer, regress of me vaines of coefficients a, b , c , d , e , ^ ^ 
therowveetorsofthematrixareaiwaysorthogonal. 

10028, According to an exampie embodiment, the te mpI a«e is to be f„,ed witb 

e, and/, the following criteria are to be met: 

1) maintain a >b >c >dpmri a ^> r • ^ j- 

- - _ d and e >f t including the order and sign- 

3;;::2 ofthecoefficfentsare — — -^^-n^.^- 

5) low order powers are preferred. 
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[0030] The commonly used DCT matrix r r»u x • 

— ^.™«,«:: l < r: it™ - - 

0-9808, 0.8315, 0.5556, 0.1951, 0.9239, 0.3827 

(0031J On the other hand, for matrix T h ■ 
* - aa possible t0 those of D T J ^ " ^ *" - 

and/are: ^ P01n, ^ "^'^ * ft C « 

« = A = 2,c = l,rf=i/ 4>e = 2/=I 
(0032] I, should be noted rf 



10034] In analyzing the computational complexity of matrix T„ i, is noted that 
the power-of-2 matrix is symmetric like that of the OCT template. The s.mple 
coefficients of T 3 greatly simplify the multiplication operations, re q „inn g only 28 
add,tion computations and 10 binarysh.fi operations to compute a ,-D order-8 transform. 
Table 1. Computational Complexity Comparison 





IntDCT 


ICT 


DT 


2- 

Pow 


WHT 


Addition 


45 


34 


28 


28 


24 


Binary 
Shift 


18 


10 


10 


10 


0 



[0035] Representative integer transforms arc listed in Table 1. The power-of-2 
transform corresponding to T 3 is among the simplest. The complexity of WHT listed in 
the last column represents the lower limit of integer transforms. Considering that using 
pure.y T can avoid binary shifts, the complexity of power-of-2 is very close to the lower 
hm.t. The flow diagram of the power-of-2 transform is shown in FIG. 3. 

10036] FIG. 3 represents the adding and shifting processes of transforming a 
^X( WM X M) to a vector T(T 0) y u y 2 , r „ ^ ^ y<> y?) using 
the power-of-2 transform T„ The two examples in the left part of FIG. 3 indtcate the 
meanings of the lines and symbols. A negative symbol in a tine indicates that the 
number is subtracted. A symbol in a line indicates that the corresponding numb, is 
multiplied. 

[0037] The calculation process consists of several steps. First vector X is 

transformed to a vector A with its elements (A 0 , A, A, A, A A A a\ 

1 °' Al > A 3> A 4> A 5, A 6 , Ai) represented 
by the first column of small circles in FIG. 2, i.e: 
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A 0 =X 0 +X 7 

A\=X X +X 6 

A 2 =X 2 +X 5 

Ai=XS+X A 

A 4 =X3-X 4 

A 5 =X2-X 5 

A=X3-X 6 

A 7 =X4-X 7 

(ocas, first four elements of (he second coiu]m ^ sma]) 

denoted by (B 0 , B h B 2 , B 3 ) and are determined as: 
Bo = A 0 +a 3 
Bx=A x +A 2 
B 2 =A X -A 2 
s 3 =A 0 -A 3 

[0039, ^n^^^^^^^^ 
are denoted by (C) and are determined as: 

Q = A 4 » 2 +A 5 
C\ =A 4 -A 5 »2 
Ci=A 7 -A 6 
C 3 =A 6 +A 7 
C 4 =A 5 - A 4 
Cs=A 5 +A 4 
C 6 =A 7 +A 6 »2 
Q=A 7 »2-A 6 
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-jr.r'""-— '"*••— — 

*6=£ 3 -5 2 «1 
>2=5 3 «1 

^i = C 3 «l+c 0 
>3 = C 6 -C 5 «l 
>5 = C, + Q « l 
^7 = C 4 «l + c 7 

Ioo«, From above equatlons tha( are ^ fa 

vector Y based on power-of-2 matrix r * 

^.ntneproces, ^ ~" ^ ^o. and 10 binaIy 

(»•«] Sta^ca, mod e, s and rea, lmages can be used 

^3, Filst , the perfomance Qf (he examp)e embodimen( 
IT, r " * - ~e integ er ^ IntDC 

r: t; rr ,n recent years; icm 3 * 2 - » ~* - — - - 



oo«e represent ^ ma . r simp|jfied ^ 

«wohavea lre ad yb ee„„ S ed i „ S o m ep r ao t ioa Isy ste ms 

.oo 44J Fim , coding gain is a wjdely ^ ^ compressiQn 

^ ' S m ° deled * - AR C) Proces, the coding gain Qf a gjven J (Qm 
can be calculated analytically The AR m 

coefficient o T. " by the — - 

coefficient p. The comparison results are shown in Table 2. 

Table 2. Coding Gain (dB) of Different Transforms 



0.95 



0.90 



0.80 



DCT 



8.83 



6.28 



4.83 



3.83 



2-Pow 



S.70 



6.16 



4.73 



3.75 



8.65 



6.11 



8.40 



4.67 



3.69 



4.46 



3.50 



WHT 



7.95 



5.50 



4.15 



[0045, T ^~ 2 Wormoftheexampkembodiment 
produces htgher coding gains than those ofICT(5 3 2 n and 

than those of DT The exatnole h ^ ^ **" 

0 HdB ,ow «, „ ^ is «^ly 

OH- lower than that of DCT. Stnce IntDCT is Rented by severa, steps rathe 

thantnonCansfo^WUtsoodinggainsarenoteo^edhe, 

code I"? Theab ° VetranSfom — S -^'-nted in the H, 63+ standard 
co ec hased on TMNS, uslng ^ Vlde0 ^ ^ * 

Dtstomon (RD) curves are shown in FIGS. 4 and 5. 

r004 71 ^^^eRDcurveofthepower-o,,^^ 

i: :r aimost overiap wi * - ° f ^ -™ * • — - 

DCT A ^miia tt- 811 ^ 61101 ^ ^ s ' 10wn °y s °lid line with triangles) though inferior to 
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embodiment power-of-2 transform equals that of DTT „vi u 

bitrate, ^ ° f ° CT whlle *e gap is enlarged at high 



100481 A1,h ° Ugh °™ * - a powe,o, 2 transform the RD cu 
corresponding thereto are mueh lower man tha, of the examole „ \ 
compression efficiency of WHT whieh no ^ ^ *> 

« <— * ,w to J;r ~ ,owes * compu,ational comp '^ 

—red here. ,n genera, the PSNK d ff COrreSP ° ndin8 " ™ " ^ 

' ^ betWee " P ~ 2 - is ,ess 

10049] Continuing with the flow chart of FIG ■> 

' 01 2, quantizer 215 reduce ,i. 

r: 2,5 " * - - ■ - - - — - - — — 
,,:;:;r:;r— 

transform is simpler than IntDCT and ICT while the 

Power-of-2 transfonn ■ ■ «*™oo efficiency of the 

2 transform is similar to that of IntDCT h- u 1 

IntDCT, higher than that of ICT and 
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Stanly higher than tha, of DT and WHT. The ,ow m agnitude oftile demeWs ^ 
avcds large ntemory consumption, which „ . prob , ematjc ^ for 
transforms. 

[0051] FIG. 6 iHustra.es a genera, computer environment 600, whtch can be nsed 
to -mpiement the compression technics descnbed herein. The computer environment 
00 ,s „n, y one exantp.e of a computing environment and is no, intended to suggest a„ y 
1— n as to the scope of use or <Unctiona.it, of the computer and network 

dependency or retirement re,a,ing to any one or combination of components i.lustrated 
in the example computer environment 600. 

[0052, C-puter environment 600 includes a genera.-pnrposecomputingdev.ee 
« the form of a computer 602. The components of cotnputer 602 can include, bn, are not 
Hnuted to, one or more processors or processing units 604, system metnory 606 and 
system bus 60S that coup.es various system components including processor 604 to 
system memory 606. 

(0053, System bus 608 represents one or more of any of several types of bus 
structures, inCnding a metnory bus or mentory controller, a peripheral bus, an accelerated 
Srapbics port, and a processor or loca, bus using any of a variety of bus architectures By 
way of examp,c, snch architectures can mc.ude an Industry Standard Architecture (ISA) 
bus, a Micro Channe. Architecture (MCA) bus, an Enhanced ISA (EISA) bus, a Video 
Bionics Standards Association (VESA) local bus, a Peripheral Component 
nterconnects (PCI) bus also known as a Mezzanine bus, a PCI Express bus, a Universal 
Scnal Bus (USB), a Secure Digtal (SD) bus, or an IEEE ,394, i.e., FireWire bus 
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.0054, Co m pu ter6 0 2 mayindudeava ^ ofcomputCTre ^ biem ^ 
- ean be a„ y av ailabk medla tha( js accessjWe by computa ^ 

volatdeandnon-vo^edia, movable and no„- rem0 v abl e me d ia 

.0055, Syst e m mem „, 606 includes computer readaWe ^ ^ ^ 

16 mem °" SUCH " ra " d0m — — y (RAM) o,0; and/o, non-vCad, 

zr«"«r on,y mem " (rom) 612 ° r flash ^ ~ — 

(BIOS) „H, contain^ to basic routines ^ ^ ^ ^ 
2 "AM. HAM m „ y contejns da(a ^ program moduies 

,oo 56] Computer 602 may a , so mdude o(her removab 

«*. and/o, wri D » g t0 a _ ble> non . volatile ^ d]sk 

I " ^ — * — - « * one o r more d at 
^ 62 , A , temative]y , ^ ^ ^ 6i6> magnet;c ^ d ^ 

.0057, Tbe d,s k drives and t „e ir associated co mpute , readable media M 



ZT ma8ne h0&k62 °- d ~^--a 4 , itisappreciatedthatother 

typ* of computer readable media which can store data that is accessible by a compute 

Z:: :r (dvd) ° r - ~ — — - — : 

(RAM), read onIy memones (R0M)j eiec( m 

memory (EEPROM), and the like c a „ . u 8™nmable read-only 

Idee, can also be utilized to implement the example 
compunng system and environment. P 
10058, Any number of program modules can be 

77 " m ' "« « ^ «* -r RAM 610 , mc,udin g by a ! 

o*de 6 30, and program data 6 3 2 . Each of such operating system b 26 , one or more 
PP.-„n programs 628 , other program modules 6 30, and program data 6 3 2 (or J 

:::r - — - - - - - re s,de„, comm j su : 

the distnbuted file system. PP 

10059, A ~entercommandsandi„fo mationintocomputer602 via 
evces such as keyboard 634 and a pomting dev.ee b3 6 (e ,„ . ^ ^ £ 

connected to processmg unit o04 via input/output interfaces 640 mat are coupled to 
™,bm may be connected by omer interface and bus s.cmres, 
parallel port, game port, or a universal serial bus (USB). 

100601 M0mtOr M2 ° r <>f display device can also be connected to the 

udpier 044. in addition to monitor 642 
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rrr eraidev,cescan,nc,udeco — 

Pnn t e r6 4 6 w hl c h ca„ b e„,„ computer602vial/Omterfaces64o 

C ° mPUter 602 - °^ te '» - — ed e„v ironm e„ t using logica , 

z:r°r~ -« — — 
11 and features descrited - — j 

10062] Logica, connect between computer 602 and remo ,e co mputer 648 are 

r v ' ocal area ~ aAN) 650 Md a - e ~ ~ ™ 

- SuoH networking envtronments are commonp]ace jn 
computer networks, intranets, and the Internet. 

(0063, When minted ,„ a LAN networking environment, computer 60 2 is 

--~ork6 5 , Modem., whichcan 
I " I! ~ t0 COmPU,CT 6 ° 2 ' CM te — <° — - « - ,0 

- — and that other means of estahhshing a, ieas, one 

.006.. in a networked environment, such as that mustrated with confuting 
—men, 600, program modu.es depicted reiative to computer 602, or pol 



application programs 658 re - de on & 

Woses of i„ ustratlonj * ° f rem ° te C <~ 648. For 

' app,lcatlons or programs and other execute 
components such as the one™,;, executable program 

me derating system are illustrate u ■ 
although it is recognized that sueh " *°* bl0cks > 

"communications media." 8 edla a 1 " 1 

10067] "Computer storage media" includes volatile a„H 
»d non-removable medi, ■ , "on-volatile, removable 

' ma S ne tic tape, magnetic disk storage 
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deseed lnfomiation mi whjch can be ^ fey a computer 

10068, "Co mmunication med . „ typicalJy embodjes 

r - - r - °< - — — media also lnc d 
27 ,on : the - * — — -* o 0nununication medl 

w, red media such . . WIred netWQrk Qr djrect wired 

4eab --^^ udedwiftkftes ^ ofcomputerreadabiemedia 

m 9i Referee has been made throughou( ^ , 

rtr mbodim enc '° r " me ^^-— 8 - aParticular 
::: — - ^ - - - - refer t0 more ftan just f : 

TTT Furthemore - ,he described featares ' — - — — ^ * 

7 " " W " h0U( ~ ° r - - - « d e teils , or with other me(hods 
.0071, WhHe e xampIe e mb o diments and app]ications Qf ^ 



• the precise conflation and resources described abwe Various modifations 

rrr opera,ion ' and detmis of the " md — - - ~ 

dadosC herein without parting from the scope of the cIaimed inventjon 
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